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FOREWORD 


This  report  is  the  result  of  experiments  performed  by  Charles  W. 
Erikaen  under  contract  No.  AF  33(018)  -22642  at  the  Institute  for  Coopera- 
tive Research,  Tbs  .Johas  Hopkins  University.  The  contract  was  initiated 
under  a project  identified  by  Research  and  Develop? sent  Order  Nob  . 694-45, 
Presentation  of  Data  on  Radar  Scopes,  and  694-43,  Human  Engineering 
Analysis  of  Multiple  Operator  Air-<5round  Systems,  and  vss  administered 
by  the  Psychology  Branch  of  the  Aero  Medical  Laboratory ^ Directorate  of 
Research,  Wright  Air-  Development  Center,  vith  Jullen  M.  Christensen 
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ABSTRACT 


The  present  report  donovjhes  a eerier,  of  experiments  upon  ere  effect? 
ctf  various  conditions  of  display  upon  visual  search.  The  time  required  to 
locate  a constant  number  of  signals  in  a square  display  ve.g  determined  where 
(1)  the  number  of  irrelevant  signals  was  varied  fro®  10  to  70,  and  (<?)  when 
the  number  of  partitions  of  the  display  vss  varied  by  the  use  of  grid  lines. 
Grid  lines  were  used  to  partition  the  display  into  a 9 x 9,  a 13  x 13,  and  a 
1 6 x l6  matrix. 

The  results  snov  that  search  time  increases  both  when  the  number  of 
irrelevant  signals  is  increased  and  when  the  rr.imber  o?  partitions  is  increased 
An  explanation  was  advanced  for  these  effects  in  terms  of  the  number  of  foveel 
fixations  required  for  signal  identification  end  the  use  that  observers  r-sG;c 
of  grid  lines  in  their  plan  of  search. 


PUBLICATION  HEVTF/w 


This  report  has  beer,  reviewed  and  is  appi 


FOE  THE  COJOUNDERi 


JACK  BOlJiKRUP 
Colonel,  USAF  (mo) 

Chief,  Aero  Medical  Laboratory 
Directorate  of  Pesesrch 


i 

i 


%TAT)C  TR 


5b-l6l 


l 


1 


*r 


i 


r- 

* 

% 


w*. 

V ' 


fr; 


ISiL 


*** 

SfT- 

tV 

ft* 

*& 

ir 


s~ 

*»W 

He 

yg* 

& 


I*  ISTRODUCTIOH 


Xu  the  military  setting, visual  displays  are  used  for  a number  of  purposes 
varying  from  recognition  of  ground  return  in  radar  to  the  assimilation  of 
information  free  plotting  hoards s Irrespective  of  the  task.  In  most  cases 
there  is  a need  for  rapid  accurate  identification  or  location  of  particular 
objects  or  signals  in  the  display.  The  present  study  is  concerned  vith  certain 
perceptual  problems  involved  in  the  visual  display  of  information,  particularly 
•with  reference  to  the  task  of  visual  search. 
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on  task  confronting  the  observer  is  one 
Here  ihe  observer  is  required  to  scan  the  displey  in  order 
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of  visual  search. 

to  detect  the  presence  or  location  of  particular  signals  or  ether  encoded 
information.  In  this  task  the  structure  of  characteristics  of  the  perceptual 
field  (display)  may  be  expected  to  influence  his  performance.  Previous  research 
(i),  for  example,  has  shown  that  the  heterogeneity  of  the  field  in  terms  of 
such  visual  dimensions  as  hue,  form,  size  and  brightness  is  a significant 
factor  in  search  time.  Search  time,  in  general,  ves  found  to  increase  with 
increasing  heterogeneity  of  the  field. 


In  addition  to  heterogeneity  on  various  diiaenBioss  a display  or  perceptual 
field  can  vary  in  terms  of  other  characteristics.  One  of  these  is  the  number 
and  different  kinds  of  information  it  contains -"that  is,  how  much  blank  or 
’unoccupied  space  there  is  in  the  display.  A display  may  be  virtually  saturated 
with  signals  or  the  signals  may  be  few  in  number  and  widely  scattered  throughout 
the  display.  Perceptually  we  may  consider  this  variable  as  relating  to  the 
ratio  of  figure  to  ground  and  might  expect-  thst  the  speed  with  which  an 
observer  can  scan  the  display  in  search  of  specif lei  signals  would  be  affected 
by  this  ratio. 

Displays  also  vary  in  the  natural  or  artificial  sub-divisions  or  parti- 
tionings that  exist  in  them.  In  many  displays,  grid  lines  or  coordinates  are 
used  to  partition  the  display.  "While  these  grid  iine«  say  be  helpful  in 
specifying  the  location  of  a signal,  their-  effect  upon  speed  and  accuracy  of 
visual  search  is  unevaluated. 


The  purpose  of  the  present  experiment  was  to  determine  the  effect  upon 
visual  search  time  of  three  variables,  saturation,  partitioning,  and  search 
area.  Speed  of  visual  ocnrcv-j  *a  measured  by  the  time  it  took  a subject  to 
locate  a constant  number  of  signals  in  a display,  was  determined  when  the 
following  iacturb  were  varied;  \l)  the  uuEbs'  of  non-target  signals  in  the 
display;  (2)  the  number  of  partitions  of  the  display  was  increased  or  decreased 
by  the  use  of  grid  lines;  end  (3)  Use  total  area  of  search. 
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ypparatus. 
sight,  vas  used. 


A square  dispiay,  perpendicular  to  the  subject's  line  of 
Tie  center  of  the  display  vas  60  in.  from  the  floor.  It 
was  painted  a flat  white  in  color  and  was  ruled  off  into  equal-sized 
partitions  by  the  use  of  i/l6-tn.  black  lines.  A quarter-inch  electrode 
vas  located  at  the  bottom  of  each  of  the  partitions  and  a tiny  hook  at  the 
top,.  The  number  of  partitions  and  the  area  of  the  display  were  varied  in 
the  experiment.  A sliding  panel  vas  used  to  hide  the  display  from  the 
subject.  When  a catch  vas  released p the  panel  dropped  giving  the  subject 
a full  •’lew  of  the  display.  The  dropping  panel  also  tripped  « mieroswiten 
which  in  turn  activated  cm  electric  timer.  The  subject  located  objects  in 
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mounted  on  the  ba_k  of  the  display  which  provided 


connections  with  each  of  the  electrodes  on  the  face.  Then  telephone  jacks 
could  be  plugged  into  these  connections  so  as  to  obtain  any  desired  pattern 
of  ten  electrodes.  These  jacks  were  connected  to  a system  of  relays,  which 
were  tripped  whenever  the  subject  touched  the  stylus  to  the  corresponding 
electrode.  When  all  ten  relays  had  been  tripped,  in  any  order,  they  com- 
pleted a circuit  vhich  stopped  the  timer. 


The  signals  placed  in  the  display  were  cut  out  of  a dark  grey  cardboard. 
They  were  of  three  shapes;  triangles,  squares,  and  diamonds.  All.  were  of  *» 
constant  size,  7/S- in.  on  their  maximum,  vertical  and  horizontal  dimensions. 

Ten  triangles  were  always  used  as  the  target  signals  and  the  number  of  squares 
and  diamonds  placed  in  the  display  was  varied  experimentally. 

Subjects.  A total  of  36  students  at  The  Johns  Hopkins  University  was 
used,  20  males  and  16  females.  No  attempt  was  made  to  cont.rol  for  sex 
differences  since  a previous  study  involving  a similar  task  (?)  had  shown 
no  evidence  of  sex  difference  on  this  type  of  percept  USi,  i»iO  wOT*  task. 


Design.  The  three  experimental  variables  in  this  study  were  display 
saturation  or  the  number  of  objects  placed  in  the  display,  partitioning  of 
the  display  by  the  use  of  grid  lines,  and  the  display  area.  For  the  satura- 
tion variable,  the  subject  vas  required  to  locate  trie  ten  target  objects  when 
the  display  contained  a total  of  20,  do,  60,  and  80  signals.  Partitioning  vOJ 
varied  by  ruling  the  display  off  into  a 9 x 9,  * 13  x 33,  and  a 16  x 16  matrix 
by  the  use  or  l/lb-in.  vide  lines. 


There  axe  two  ways  in  which  we  can  vary  the  number  of  partitions  in  the 
display.  One  ia  to  hold  constant  the  area  of  the  display  ks  ve  vary  the 
number  of  partitions.  In  this  case  the  size  of  the  individual  partitions  will 
vary . The  other  inethod  ie  t-o  hold  constant  the  size  of  the 
tions,  bur.  allow  the  total  area  wf  the  display  to  vary.  In  the  pi 
study  both  methods  of  varying  the  number  of  partitions  were  used. 
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accomplished  by  usinpc  three  different  display  areas,  18,  24,  and  32  in. 
square.  Thus  it  was  possible  to  compare  differences  between  number  of  parti- 
tions when  a constant- sized  di spicy  '-as  used  and  also  when  the  size  of  the 
partitions  in  the  display  was  Kept  eoretan’-. 

The  three  experimental  variables  were  arranged  in  a y x 4x3  factorial 
design.  Twelve  subjects  were  assigned  at  random  to  each  of  the  three  display 
sizes.  Each  subject  vas  tested  once  under  each  of  the  12  combinations  of  the 
three  different  partitionings  and  the  four  saturation?.  Hithir.  each  display 
size,  the  order  in  which  subjects  were  tested  on  the  variouR  combinations 
of  saturations  and  partitioning  vas  counterbalanced  in  a latin  square  design. 

Subjects  were  run  individually.  They  were  instructed  to  locate  the  ten 
triangles  in  the  display  as  rapidly  as  possible  by  touching  the  stylus  to 
the  electrode  In  the  partition  where  the  triangles  were  placed.  In  order  to 
eliminate  one  source  of  error,  subjects  wore  instructed  to  count  the  triangles 
so  as  to  be  sure  that  they  had  located  all  ten.  The  subjects’  score  was  the 
time  required  to  locate  the  ten  triangles. Search  time  was  measured  to  the 
hundredth  of  a second.  Ml  subjects  had  received  extensive  practice  on  a 
similar  tesk  prior  to  beaming  the  experimental  trials. 

There  were  Mways  ten  target  signals  in  the  display.  They  wore  located 
among  tne  partitions  in  the  disnlav  according  to  12  patterns.  These  patterns 
had  beer,  selected  to  meet  the  following  criteria:  (l)  No  two  target  signals 

were  to  be  in  adjacent  partitions,  and  (2)  st  least  one  target  signal  'was  to 
occur  in  the  top  tvo  rows  of  the  display  and  at  least  one  in  the  bottom  row. 
Within  display  sizes,  the  12  patterns  were  varied  among  the  12  combinations 
of  the  different  numbers  of  partitions  and  saturations  in  a latin  squr’-e 
different  from  that  used  for  counterbalancing  subjects  so  that  no  subject 
obtained  the  same  pattern  twice. 


III.  RESULTS 


The  search  t tries  obtained  under  the  various  treatment  conditions  were 
subjected  to  a ©edified  four-way  analysis  of  variance  (saturation,  partitions,  ; 
display  size  and  individuals).  A summary  of  this  analysis  is  shown  in  Table  1.— < 


1 / Although  errors  were  recorded  they  were  so  very  rare  that  no  analysis  of 
them  was  merited. 

2/  The  method  of  analysis  is  identical  with  that  described  by  Lindquist  (4) 
under  Plan  VT.  The  search  times  were  examined  for  evidence  of  skewed  distribu- 
tions, but  they  appeared  from  examination  to  be  relatively  normal.  In  view  of 
this  and  also  taking  into  consideration  the  report  (5)  that  moderate  departures 
from  normality  have  little  effect  upon  signif icauee  levels,  it  was  considered 
unnecessary  to  use  a logsjrit-hoiic  or  reciprocal  transformation  on  the  time  scores 
Bartlett’s  test  when,  applied  to  the  data  offered  no  ba«ie\  f-"  rejecting  the  null 
hypothesis  that  the  variances  were  homogeneous. 
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Source 
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F ratio 


Total 

Display  saturation 


9684.1 

^67.5 
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* Significance  beyoon  the  .05  level 
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1422.5/22.1  - .117.2** 


Display  partitions 

519.1 

2 

289.9/16.7  ” 

17. 3** 

Display  arass 

5«3.5 

2 

294.2/61.9  * 

4.8* 

Sub  f)cC  1 0 

204?=7 

33 

61.9/ 

Saturation  x partitions 

91.4 

6 

15.2/8.5  » 

1.78 

Saturation  x area 

47.5 

6 

7.9/12.1  » 

.65 

Partition  x area 

14.1 

4 

3.5/16.7  * 

.21 

Saturation  x peu.  tifcioue 

x area 

40.5 

*1  O 
JX 

3. 4/6 c 5 s 

.39 

1 
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Pooled  subJectB  by  saturation 

1201.7 

99 

12.1/ 

Pooled  subjects  by  partitions 

1102.3 

66 

16.7/ 

1 

Pooled  subjects  by  saturations  i 

by  partitions 

1688.5 

X9& 

0.5/ 

Composite  within  subject  error 

3992.9 

303 
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From  thin  table  it  can  be-  seen  ths.t  tvo  of  the  experimental  variable?, 
saturation  and  partitioning,  were  significant  beyond  the  .001  level  of  confi- 
dence, and  the  third  variable,  display  area,  van  significant  at  the  .0? 
level.  However,  nena  of  the  interactions  between  these  three  variables 
approached,  significance.  Table  £ presents  the  scan  search  times  the 
various  combinations  of  oo  uuTa  viOTlS  and  partitions  for  each  display  area. 

Xt  vi 11  be  noted  that  increasing  the  saturation  or  the  number  of  signals  in 
the  display  lead®  to  increase  in  search  t.-im**.  Also  the  more  the  display  is 
partitioned  off  by  the  use  of  grid  lines,  the  longer  is  the  time  required  for 
locating  the  target  signals. 

These  effects  can  be  more  readily  perceived  graphically.  In  Figure  1 
search  time  hs?  boss  plotted  as  a function  of  display  saturations  and  number 
of  partitions.  Search  tine  has  been  averages  through  display  areas.  As  is 
apparent,  search  time  increases  acnotcnically  as  the  number  of  non-target 
signals  in  the  display  increases.  In  fact,  the  function  would  appear  to  be 
linear,  hut.  the  points  are  too  few  in  number  to  indicate  the  exact  shape  of 
the  function.  It  can  also  be  seen  from  t’nie  graph  that  search  time  is  leBs 
when  the  display  hii3  the  minimum  number  of  partitions.  The  9 x 9 partitioning 
results  in  the  quickest  search  for  ail  saturations  and  the  l6  x 16  the  slowest. 
This  latter  effect  is  further  illustrated  ir  Uigurs  2 where  se  arch  uiS'Z  ilci S 
been  plotted  as  a function  of  the  number  of  partitions  in  the  display  and  the 
display  area. 

From  Figure  2 it  is  apparent  that  the  relation  between  search  time  and 
total  search  area  is  not  a monotonic  one.  The  slowest  location  is  obtained 
with  the  2k  in.  square  display.  On  the  other  hand,  location  is  nearly  as 
rapid  with  the  32  in.  square  as  it  is  with  the  18  in.  one. 
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ien  a display  is  partitioned  oif  Into  a greater 
number  of  areas,  the  size  of  the  individual  partitions  or  cells  is  decreased. 

It  is  conceivable,  therefore,  that  the  differences  in  search  time  obtained 
with  differing  number  it  of  partitions  nur  he  *.V*e  tc  increasing  difficulty  in 
ideutifyiufc  or  discriminating  a signal  in  « smaller  partition.  As  a check  on 
thin  possibility,  the  three  display  sizes  were  so  chosen  that  the  partitions 
resulting  from  the  9x9  partitioning  of  the  smallest  display  were  the  same 
size  as  the  cells  resulting  from  the  13  x 13  partitioning  of  the  middle  sized 
display  and  the  16  x l6  partitioning  of  the  largest  display.  The  failure  to 
obtain  a significant  interaction  between  the  three  experimental  variables 
indicates  that  the  effects  upon  search  time  due  to  partitioning  cannot  be 
ascribed  to  the  varying  size  of  the  individual  partitions  or  ceils  in  the 
display. 


This  can  be  clearly  seen  from  Figure  2.  If  the  effects  upon  search  time 
due  to  the  number  of  partitions  was  solely  the  result  of  the  smaller  size  of 
the  cells,  it  would  be  expected  that  the:  ee:arch  time  for  the  9x9  partitioning 
of  the  l6  xn.  matrix,  the  13  x 3.3  partitioning  cf  the  2k  in,  matrix  and  the 
lo  t 16  partitioning  cf  the  3k  in.  matrix  to  be  agproximutcl y equal  c^ept  for 
a slight  difference  resulting  from  differences  in  total  search  area.  Comparison 
of  these  three  points  in  Figure  2 shows  that  increases  in  wear  ell  tiui3  uoSvC ! tcc. 
with  increases  in  the  number  of  partitions  is  much  greater  than  can  be  attri- 
buted to  differences  in  the  total  search  area  or  size  of  the  display. 
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Figure  1.  2asr;h  tias  as  a function  oi  dicpiej  saturation  sni  psrtitionitl 
Search  ti xse  has  been  averaged  through  the  three  hispiay  ureas  sad  each  poi 
is  the  Bean  for  36  subjects. 
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DISCUSSION 


IV. 


The  results  presented  ebove  can  be  briefly  summarised  us  follows; 

(1)  As  the  masher  of  signals  or  objects  in  the  display  was  increased,  the 
time  required  for  the  vieual  location  of  a constant  cumber  of  specific  signals 
also  increased:  (2)  when  the  visual  field  or  display  was  partitioned  into 
8l,  169,  and  256  equal  sectors  by  the  use  of  grid  lines,  the  speed  of  visual 
search  decreased  «ith  the  increase  in  the  number  of  partitions;  and  (3)  eo 
the  siao  of  the  display  or  search  area  was  varied,  it  ver,  found  that  visual 
search  was  most  efficient  when  the  search  area  was  18  and  32  in.  square  sad 
least  effective  when  2k  in.  square. 


The  first  of  these  findings  agrees  quite  well  with  our  intuitive  expecta- 
tions. It  seems  reasonable'  that  it  would  be  more  difficult  to  locate  a parti- 
cular object  or  objects  when  the  number  of  objects  among  which  they  were  inter- 
spersed was  increased ..  in  tne  present  ease  it  would  appear  that  this  effect 
can  be  explained  or  understood  in  terms  of  the  master  of  visual  fixations 
required  for  the  accomplishment  of  the  tssk.  Here  the  triangles  were  easily 
discriminabie  from  the  squares  and  diamonds  »s  indicated  by  the  fact  that 
subjects  rarely  ss&dc  an  error  by  touching  the  stylus  to  the  electrode  beneath 
an  incorrect  signal.  While  peripheral  vision  is  adequate  for  detecting  the 
presence  of  a signal  against  the  display  field,  it  would  appear  that  foveal 
vi Rton  Wes  used  or  required  to  make  the  discrimination  between  target  and 
non-target  signals. Detection  by  peripheral  vision  leads  +.0  a brie?  foveal 
fixation  while  the  signal  is  identified  as  a target;  or  non-target  signal. 

If  we  take  as  the  simplest  case  where  onxy  target  signals  are  present  in  the 
display,  only  as  many  fixations  as  there  are  target  signals  is  required. 
However,  increasing  the  number  of  non-target  signals  in  the  display  leads  to 
more  visual  fixations.  Every  signal  picked  up  in  peripheral  via  ion  lee.de  to 
s fovtal  fixation.  Thus  if  search  time  is  -orimarily  dependent  upon  the  time 
for  fixation,  increasing  the  number  of  objects  in  the  display  would  be  expected 
to  lead  to  a linear  increase  in  search  tine.  Such  a linear  relationship 
v=-  suggested  by  the  obtained  data. 


Explanations  for  the  effects  obtained  by  increasing  the  number  of  parti- 
tions of  the  display  are  not  readily  apparent.  The  increase  in  search  time 
with  increases  in  the  number  of  partitions  has  been  shown  in  the  present  data 
to  be  due  to  the  effect  of  the  number  of  partitions  par  se  and  not  to  the 
absolute  eize  of  the  separate  divisions.  It  is  possible  thet  the  presence  ox 
grid  lines  in  the  display  has  a distracting  effect  upon  visual  search.  French 
(3)  ha  a shewn  that  irrelevant  signals  in  a display  impede  the  recoi-nitio  of 
target  signals.  He  has  termed  this  effect  visual  noise  on  the  analogy  of  noise 
in  an  auditory  system.  However,  labeling  such  effects  as  visual  noise  does 
not  contribute  to  an  underctanding  ef  the  effects. 


while  good  form  discrimination  can  be  obtained  in  peripheral  vision  hy 
training,  it-  must  be  resembered  that  the  present  subjects  were  untrained.  It 
also  seems  likely  that  even  with  training,  if  the  task  permits,  feveal  vision 
will  be  used  for  discriminations  in  preference  to  peripheral  cues. 


A likely  explanation  foj  the  pi-eseut  data  Caii  be  Obtained  if  V" 
hew  subjects  approach  tne  task  or  visual  search  and  what  use  they  aa3re"o-f"~sr-*a 
lines  Grid  lines  in  a display  not  only  break  the  display  up  into  cells  and 
partitions,  they  also  organise  the  display  into  col»anqg  mid'rowg*  This  orveniisa 
cion  of  the  display  may  he  expected  to  affect  the  subject's  method  of  search* 

It  would  appear  that  subjects  scan  a display  by  either  columns  or  rows  when  * 
these  are  present  in  the  display.  Since  increasing  the  number  of  partitions 
in  a display  results  in  an  increase  in  the  number  of  Columns  or  row*  that.  a 
subject  must  scan,  a linear  relation  might  be  expected  between  the  number  of 
partitions  and  the  speed  of  search.  The  data  in  Figure  2 do  suggerit  such  & 
linear  relationship. 


The  findings  in  the  present  study  with  respect  to  search  area  may  well  be 
an  artifact  of  the  method  the  subjects  were  required  to  use  to  indicate  that 
they  had  located  a target  signal.  The  slower  search  obtained' for  the  "in . 
square  display,  as  compared  with  the  1°  and  32  is.  square  displays,  may  reflect 
a change  in  the  perceptual-motor  task.  It  was  observed  that  sufcj-ctg  tended  to 
use  eye  and  head  movements  to  scan  the  18  and  2h  in.  displays,  meanwhile  ho' *-1™ 
the  stylus  In  a fixed  position.  With  the  3?  in.-  dispi-y  subjects  tended  *■-> 
moire  the  stylus  beck  and  forth  across  the  rows  of  the  display  in  synchrony 
with  their  visual  scanning.  When  the  stylus  ie  held  i.n  a fixed  position  ^ 
increasing  the  area  of  the  display  required  longer  in  ortier  to'aouch 

the  electrode  beneath  the  signal.  However,  when  the  are*  of  the  display 
becomes  great  enough,  the  shift  over  to  a motor  scanning  again  reduces  the 
extent  of  the  required  movements  once  a target  signs!  has  been  identified 
Such  an  interpretation  suggests  that  visual  search,  independent  of  the  motor 
response  necessary'  to  signify  location,  is  largely  independent  of  the  Aic-lav 
areas  used  in  the  present  experiment,  " J”“F 


V.  SUMMARY 


fTTh»^  r»v*»ao’Mt  et-ufltf  w- c»  r»A»>oorrw3.^  iH  f>i  +.>«£  ti  r\-i>  , 

, . --U  w-t w several  characteristics 

of  visual  displays  upon  speed  cf  visual  search.  The  time  required  tco  locate  a 
constant  number  of  signals  in  a square  display  was  determined  where  '(1)  4'ht* 
number  of  irrelevant  aignals  was  varied  from  1G  to  70,  (2)  when  The  number 

of  partitions  of  the  display  was  varied  by  the  use  cf  grid  lines.  Grid  lines 
were  used  tc  partition  the  display  into  a 9 x 9,  s 13  ~ 13.  x ^ matrix 

The  results  shew  that  search  time  increases  ooth  the  number  of  irre^e 

want  signals  is  increased  and  when  the  number  of  partitions  is  increased."  An^ 
explanation  was  advanced  for  these  effects  in  terms  of  the  number  of  fovea) 
fixations  required  for  signal  identification  and  the  use  obo^rvera  m»v,»  nr 

grid  lines  in  their  plan  of  search,  " or 
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